Talking Faces
نویسندگان
چکیده
We present a method to generate mouth animations coupled with moderate movements of the head. Our method uses a coarse 2D textured mesh representation of images. With hardware texture mapping, we obtain 30 frames/sec animations on modest PC platforms. The synthesized animation sequence is realistic and lively. Radial basis functions are used in the underlying animation engine. At each phoneme transition, the positions of the mesh nodes are determined by RBF coefficients associated with a set of sparse feature points. Blending textures from key frame images on the displaced mesh produces animation sequences of talking faces.
منابع مشابه
Auditory-visual perception of talking faces at birth: a new paradigm
Newborn infants prefer faces to all other visual displays. All previous studies of face recognition in newborns used schematic faces, photographs or static real faces. In our study, we used video films to explore, for the first time, recognition of talking faces, in newborns. Our results suggest that video films of talking faces are very salient stimuli for newborns and can enhance face recogni...
متن کاملAudio-visual synthesis of talking faces from speech production correlates
This paper presents technical refinements and extensions of our system for correlating audible and visible components of speech behavior and subsequently using those correlates to generate realistic talking faces. Introduction of nonlinear estimation techniques has improved our ability to generate facial motion either from the speech acoustics or from orofacial muscle EMG. Also, preliminary evi...
متن کاملSearching for a talking face: the effect of degrading the auditory signal.
Previous research (e.g., McGurk & MacDonald, 1976) suggests that faces and voices are bound automatically, but recent evidence suggests that attention is involved in a task of searching for a talking face (Alsius & Soto-Faraco, 2011). We hypothesized that the processing demands of the stimuli may affect the amount of attentional resources required, and investigated what effect degrading the aud...
متن کاملTarget practice on talking faces
A method is described for video-based tracking and analysis of talking heads. Although dots on the face and head are tracked now, clean faces will be tracked once a satisfactory optical flow technique is found. The analysis consists of decomposing the head and face motion components into a common mode and the residual, thus eliminating the need for complex marker tracking and head correction of...
متن کاملKinematics-Based Synthesis of Realistic Talking Faces
A method is described for animating talking faces that approach both cosmetic and communicative realism. The animations can be driven directly from a small set of time-varying positions measured on the face. This method of animation provides distinct benefits for both industrial and behavioral research applications, because the kinematic control parameters are easily obtained and are highly cor...
متن کاملA Personalized Talking/moving Head Presentation Using Image-based Transformations
This paper addresses the problem of multimedia presentation of a moving and talking head. Existing approaches either use a 3D geometrical representation or multiple 2D views to model and reconstruct faces. To achieve realistic appearance and personalization, and avoid complex models, we propose two approaches. First, we show how pure image-based view morphing can be used to create new moving an...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2000